How-To Guides
How to Predict Training Time Using Metadata
- Problem: Estimating runtime for deep learning models on HPC resources.
- Steps:
- Load
dataset-new.csv
. - Select relevant features (
batch
,epochs
,gpu_core_count
, etc.). - Train a regression model.
- Load
- Advanced Tips: Integrate HLO graph features for improved accuracy using GNNs.
- Troubleshooting: Ensure consistent preprocessing of categorical fields.
- Example: Refer to the baseline notebook.